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ABSTRACT 

The stepped-up reliability coefficient does not have 
the same standard error as an ordinary correlation coefficient. 
Fisher's Z -transformation should not be applied to it. Appropriate 
procedures are suggested. (Author) 
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Abstract 

The stepped -up reliability coefficient does not have the same 
standard error as an ordinary correlation coefficient. Fisher's z - 
transformation should not be applied to it. Appropriate procedures are 
suggested. 



Variance-Stabilizing Transformation of the 
Stepped-lJp Reliability Coefficient*^ 
Frederic Lord 
Educational Testing Service 

The stepped-up reliability coefficient R considered here is given 
oy the familiar Spearman-Brown formula 



1 + r 



where r is the observed product-moment correlation between two supposedly 
parallel sets of measurements and ; or, perhaps better, where r 

is the maximum likeDihood estimate of their correlation under the assump- 
tion that X^ and X^ are bivariate normal and have equal population 
variances (Jackson & Ferguson, 19i^l, eq* 85). Of course, R is the esti- 
mated reliability of + X^ • Although R is an estimate of a product- 
moment correlationi coefficient, it is not itself a product -moment cor- 
relation and consequently does not have the frequency distribution and the 
sampling variance of a sample product -moment correlation* 

For either definition of* r , assuming bivariate normality, as we 
shall throughout, the large -sample variance of r is 

Var r = (1 - p^)^/N , (2) 

where p is the population correlation. The large-sample variance of R 
is easily found from (l) and (2) by the "delta" method (Kendall & Stuart, 
1958, section 10.6) to be 

Var R = i^(l - P)^/N , (5) 



where P = 2p/(l + p) is the population value of R . Kristof (1965) 
has shown the exact sampling variance of R to be 



2 ^ i.(N - 1)(N - 2) _ ^ 

^ (N - 5r(N . 5) 



Since R is not normally distributed in samples of typical size, 
research workers sometimes apply Fisher's z -transformation to R and 
assume that the transformed value has a variance of 1/(n - 5) regardless 
of the value of P . This is incorrect. The large-sample variance of 
E ^[log(l + R) - log(l - R)] is found to be i^/N(l + P) . This is 
almost always larger than 1/(N - 5) • It is not independent of P . 

The variance -stabilizing transformation for R can be found from (5) 
by a standard procedure (Kendall & Stuart, 1958^ Exercise 16.18; 
Eisenhart, 19^7): 



^(N Var R)"2 dP 



i f 

= 4 log(l - R) . 



The large-^amiJ.c variance of Z is 1/n , as required, regardless of the 
value of P • Rewriting Z in terms of r shows, as should be expected, 
that 



z = 4 iog(i - 



2r 



) 



1 + r 



= i[log(l + r) - log(l - r)] 



(5) 



which is sii. D3.y Fisher's z -transformation for r . Conclusions reached 
from a study of suitably transformed R must be the same as those from 
a study of suitaoly transformed r . 

Kristof (196^) has given a large- sample^ likelihood ratio test for th 
case where Just two values of R are to be compared. Where t^;o or more 
values of R are to be compared^ they can be transformed by (k) or (5) 
and each treated (possibly in an analysis of variance) as normal with vari 
ance 1/(N - 5) • This procedure will have good properties in samples 
of moderate size^ at least in the case where r is the sample product- 
moment correlation^ since such properties have been demonstrated for 
Fisher's z -transformation. This procedure might be applied, for example 
to data studied by Traub and Hambleton (1972). 
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